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Nonadditivity  in  Inference  Judgments 


It  has  been  known  for  some  time  that  subjects  in  Bayesian  inference 
tasks  produce  data  that  are  more  like  averages  than  they  are  like  inferences 
(Shanteau,  1970,  1972) .  In  a  recent  series  of  papers  (Lopes,  1981,  1982) , 

I  have  argued  that  this  may  come  about  because  subjects  in  these  tasks  integrate 
information  serially  via  an  "anchoring  and  adjustment"  process  (Elnhora  & 
Hogarth,  1982;  Lopes  &  Johnson,  1982;  Lopes  &  Oden,  1980;  Tversky  &  Kahneman, 
1974;  Walls ten,  1976b)  in  which  "new"  Information  is  integrated  into  "old" 
judgments  by  adjusting  the  old  value  toward  the  new  information,  thus  producing 
a  final  value  that  lies  somewhere  between  the  two. 

Shanteau  (1970)  proposed  that  the  inference  process  follows  a  constant 
weighted  averaging  rule  in  which  the  response  to  n  samples  is  a  weighted  (w^) 
average  of  the  scale  values  (s^)  of  the  several  sample  events: 
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In  Shanteau 's  model  the  weight  terms,  which  are  assumed  to  sum  to  unity,  can 
vary  as  a  function  of  the  serial  position  in  which  a  sample  is  presented 
or  processed.  They  do  not,  however,  vary  as  a  function  of  the  scale  value  of 
the  sample  Information.  The  term  WqSq  is  interpreted  as  an  initial  decision 
state. 

Wallsten  (1972)  pointed  out  that  the  constant  weighted  averaging  model 
is  formally  equivalent  to  the  Bayesian  model  in  that  both  models  are  additive 
in  the  sense  of  conjoint  measurement  (Krantz,  Luce,  Suppes,  &  Tversky,  1971). 

This  is  easiest  to  see  by  considering  that  Bayes'  theorem  is  additive  when  a 
log  odds  transformation  is  applied  to  both  sides. 

Shanteau  (1975)  later  attempted  to  bypass  the  formal  equivalence  between 
his  averaging  model  and  the  Bayesian  model  by  finding  a  qualitative  distinction 
between  the  two  that  could  be  tested  experimentally.  He  approached  the  problem 
by  examining  the  effect  of  nondiagnostic  samples  on  subjects'  judgments. 

Shanteau  reason e^_that  if  subjects  moved  their  judgments  toward  a  neutral  value 
after  presentation  of  nondiagnostic  information,  this  would  provide  critical 
evidence  against  the  Bayesian  model  since,  according  to  that  model,  nondiagnostic 
information  should  not  affect  the  judgment. 

Subjects'  responses  to  nondiagnostic  information  confirmed  Shanteau' s 
expectations  and,  thus,  seemed  to  lend  support  to  the  notion  that  subjects 


In  Bayesian  tasks  use  some  sort  of  averaging  mechanism.  Wallsten  (1976a) , 
however,  pointed  out  that  the  averaging  model  correctly  predicted  subjects' 
responses  only  In  cases  in  which  the  nondiagnostic  Information  was  presented 
following  presentation  of  diagnostic  Information.  For  cases  In  which  non¬ 
diagnostic  Information  was  presented  first,  the  subjects'  responses  were  better 
described  by  the  Bayesian  formulation. 

Wallsten  argued  that  a  modified  version  of  the  Bayesian  model  could  do 
better  than  either  the  averaging  model  or  the  simple  Bayesian  model.  In  his 
new  model  Wallsten  outlined  a  stepwise  procedure  In  which  sequence  Information 
determines  which  of  two  additional  parameters  (which  increase  and  decrease 
judgments  selectively)  is  used  to  supplement  the  basic  Bayesian  formulation. 

This  modified  model  was  not  Intended  to  be  taken  seriously  as  a  process 
account  of  performance  in  the  Bayesian  task  (see  Wallsten,  1976a,  p.  330). 
However,  Wallsten  (1976b)  noted  that  the  modified  model  is  a  special  case  of 
an  additive  difference  model  which  he  proposed  as  a  general  description  of 
human  inference  processes. 

Wallsten 's  additive  difference  model  is  of  Interest  because  it  was  based 
on  the  same  sort  of  anchoring  and  adjustment  notion  that  has  guided  the  present 
research.  However,  as  I  have  argued  elsewhere  (Lopes  &  Johnson,  1982;  Lopes 
&  Oden,  1980),  anchoring  and  adjustment  can  produce  differentially  weighted 
averaging  in  which  the  weight  of  a  stimulus  item  can  vary  with  factors  other 
than  serial  position.  This  is  Important  because  differentially  weighted 
averaging  is  distinguishable  both  from  Shanteau's  (1970)  constant  weighted 
averaging  model  and  from  Wallsten 's  (1976b)  additive  difference  model  by 
virtue  of  the  fact  that  it  is  nonadditive.  . 

For  illustration,  consider  Figure  1.  The  rows  and  columns  of  the  matrix 
give  the  absolute  weights  and  the  scale  values  for  four  hypothetical  stimuli. 

The  entires  in  the  four  cells  show  how  these  are  combined  into  a  weighted  average 
Notice  that  there  are  three  different  scale  values  (11,  13,  and  15)  and  two 
different  weights  (10  and  1) .  The  different  scale  values  can  be  taken  to  repre¬ 
sent  different  values  of  stimulus  Information  and  the  different  weights  can  be 
taken  to  represent  different  degrees  of  importance  of  the  associated  stimulus 
Information.  For  example,  the  weight  of  a  particular  stimulus  item  might  be 
affected  by  its  reliability,  its  diagnosticlty,  or  its  relative  novelty. 

Note  that  the  averaged  values  in  the  first  column  decrease  from  the  first 
row  to  the  second  row.  If  additivity  holds,  the  averaged  values  within  the 
second  column  must  also  decrease  from  the  first  row  to  the  second  row  since 
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Weight  =  10  Weight  =  1 

Scale  value  =  11  Scale  value  =  11 

Weight  =  10 
Scale  value  =  13 

Weight  =  1 
Scale  value  =  15 


Figure  1.  illustration  of  how  differential  weighting  within  the 

same  factor  can  produce  violations  of  ordinal  independence. 
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additivity  requires  ordinal  Independence,  i.e.,  that  the  ordinal  relationships 
of  data  In  colunns  (and  rows)  must  be  the  same  for  all  columns  (and  rows) . 

It  is  clear  from  the  figure,  however,  that  this  does  not  occur.  Instead,  the 
values  In  the  second  column  increase  from  the  first  row  to  the  second  row  so 
that  if  these  data  were  represented  as  a  graph,  the  lines  representing  the  two 
rows  would  actually  cross  one  another. 

It  is  important  to  note  that  the  presence  of  differential  weighting  within 
factors  allows  violation  of  ordinal  Independence  but  does  not  require  it. 

The  reader  may  verify  that  if  the  respective  weights  in  Figure  1  are  set  at 
2:1  Instead  of  10:1,  no  crossover  occurs;  i.e.,  the  data  are  ordlnally  additive. 
Thus,  whether  or  not  one  gets  violations  of  ordinal  independence 

is,  in  part,  a  matter  of  the  relative  magnitudes  of  the  particular  weights  and 
scale  values  that  are  assigned  to  the  stimuli.  In  other  words,  finding  viola¬ 
tions  of  ordinal  independence  Implies  nonadditivity,  but  not  finding  such 
violations  does  not  imply  additivity. 

It  might  seem  that  violations  of  ordinal  Independence  such  as  those  illus¬ 
trated  in  Figure  1  would  be  unlikely  to  occur  in  psychological  experiments. 
However,  essentially  identical  violations  of  additivity  were  found  previously 
(Lopes  &  Oden,  1980)  in  tests  of  an  averaging  model  of  similarity  judgment. 

Thus,  violations  of  additivity  might  occur  in  Bayesian  tasks  as  well.  In  any 
case,  it  is  reasonable  and  important  to  look  for  potential  violations  of 
additivity  since  this  is  the  only  way  to  distinguish  mathematically  between 
averaging  processes  such  as  the  present  serial  adjustment  model  and  other 
modified,  but  still  additive,  versions  of  the  Bayesian  model  such  as,  e.g., 
Wallsten's  additive  difference  model. 

This  paper  reports  the  results  of  two  preliminary  studies  aimed  at  testing 
for  nonadditivity  in  a  Bayesian  task. 

Experiment  1 


Method 

Experimental  task.  Subjects  were  asked  to  make  judgments  about  the 
maintenance  of  hypothetical  machines  based  on  samples  of  parts  produced  by 
the  machines.  The  judgment  concerned  whether  or  not  a  critical  spring  has 
brokan  inside  the  machine.  Subjects  were  told  that  normal  machines  have  a 
rejection  rate  of  about  10  parts  per  1000  (H10/1000)  whereas  machines  with 
broken  springs  have  a  rejection  rate  of  about  22  parts  per  1000  (H22/1000). 
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Thus,  the  general  task  was  to  decide  between  alternative  Bernoulli  processes, 
one  with  j>  ■  .010  and  the  other  with  £  ■  .022,  where  £  is  the  probability  of 
a  rejected  part. 

Stimulus  design.  The  stimuli  for  each  trial  were  pairs  of  samples. 

The  individual  samples  each  contained  numerical  information  about  the  esti¬ 
mated  rejection  rate  for  the  machine  (i.e.,  a  digit  between  10  and  22)  and 
also  Information  about  the  reliability  of  the  sample.  Subjects  were  told  that 
samples  could  be  either  "spot  checks"  or  "full  checks."  The  instructions  for 
this  ran  as  follows: 

"Basically  there  are  two  different  types  of  samples  that  are  used. 

One  type  of  sample  is  called  a  spot  check.  These  are  done  very 
quickly  by  just  taking  a  very  small  number  of  parts  and  using  this 
to  get  a  rough  estimate  of  the  machine's  rejection  rate.  Obviously, 
spot  checks  give  only  ballpark  data.  The  other  type  of  sample  is 
called  a  full  check.  These  are  very  thorough  checks  of  a  large  number 
of  parts  and  are  used  to  give  good  estimates  of  the  machine's 
rejection  rate." 

The  spot/full  manipulation  was  Intended  to  allow  the  weight  of  a  sample  to  be 
varied  independently  of  its  content. 

Experimental  pairs  were  generated  using  the  set  of  six  2x2  factorial 
designs  shown  in  Figure  2.  Matrices  "Control  L"  and  "Control  H"  were  included 
as  checks  to  be  sure  that  in  pairs  having  both  a  full  check  and  a  spot  check, 
the  spot  check  would  not  simply  be  ignored.  Matrices  "Critical  LI",  "Critical 
L2",  "Critical  HI",  and  "Critical  H2"  were  the  potentially  nonadditive  matrices 
in  which  stimuli  having  different  weights  appear  In  the  same  factor.  Note 
that  the  values  given  In  the  matrices  are  Intended  only  to  show  the  pattern  of 
Interaction  that  would  be  expected  if  nonadditivity  holds.  The  particular 
values  were  calculated  using  weights  of  10  and  1,  respectively,  for  full  checks 
and  spot  checks,  and  setting  the  scale  values  of  the  sample  equal  to  the  number 
of  rejects. 

Procedure.  Subjects  were  run  Individually  in  sessions  that  took  about 
30  minutes.  At  the  beginning  of  a  session  subjects  were  brought  Into  a  sound 
proof  booth  and  seated  In  front  of  a  computer  controlled  video  terminal.  The 
stimuli  were  presented  in  the  middle  of  the  video  screen  with  the  samples  one 
above  the  other,  i.e., 

FULL  CHECK  11 
SPOT  CHECK  (15) 


5 

Spot  16 


Control  L 

Control  H 

Full  11  Full  12 

Full  21  Full  20 

11.4 

12.3 

11.5 

12.4 

7 

Spot  16 


20.6 

19.7 

20.5 

19.6 

Critical  LI 
Full  11  Spot  11 


12.0 

12.8 

11.4 

13.0 

Critical  HI 
Full  21  Spot  21 


20.0 

19.2 

20.6 

19.0 

Critical  L2 

Critical  H2 

Full  12  Spot  12 

Full  20  Spot  20 

Figure  2.  stimulus  design  for  experiment  1  with  illustration 
of  nonadditive  pattern  in  critical  matrices, 
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Parentheses  were  put  around  values  from  spot  checks  as  an  additional  reminder 
to  the  subject  that  these  values  were  "rougher  estimates  than  the  one(s)  from 
the  full  check(s) 

At  the  bottom  of  the  video  screen  there  was  an  unmarked  response  scale 
anchored  at  the  right  by  the  words  "CERTAINLY  FAULTY,  22/1000"  and  at  the 
left  by  the  words  "CERTAINLY  NORMAL,  10/1000."  Just  above  the  scale  was  a 
response  arrow  that  could  be  controlled  by  movement  of  a  joystick.  Subjects 
responded  to  each  stimulus  pair  by  positioning  the  response  arrow  along  the 
scale  and  then  pushing  a  button  to  signal  the  computer  to  store  the  response. 
After  this,  an  "X"  appeared  at  the  middle  of  the  scale  and  the  subject  had 
to  move  the  response  arrow  past  the  X  and  then  push  the  button  again.  This 
initiated  the  next  trial. 

Altogether  there  were  10  trials  for  practice  followed  by  two  replications 
of  the  experimental  pairs.  These  were  interspersed  with  occasional  "end  anchors" 
that  comprised  pairs  of  samples  that  both  strongly  supported  one  or  the  other 
hypothesis.  This  gave  a  total  of  82  pairs  in  all.  Stimulus  pairs  within  repli¬ 
cation  were  ordered  randomly,  but  with  the  restriction  that  no  two  pairs  from 
a  given  matrix  follow  one  another  in  the  ordering.  Stimuli  within  a  pair  were 
counterbalanced  so  that  the  row  stimulus  appeared  in  the  upper  position  in  one 
replication  and  in  the  lower  position  in  the  other  replication. 

Subjects.  The  subjects  were  41  student  volunteers  from  the  University  of 
Wisconsin — Madison.  They  served  for  credit  to  be  applied  to  their  course  grade 
in  Introductory  Psychology. 

Results  and  Discussion 

The  results  of  Experiment  1  are  shown  in  Figure  3.  Judgments  have  been 
scored  so  that  0  indicates  complete  confidence  that  the  machine  is  normal 
(H10/1000)  and  1  indicates  complete  confidence  that  the  machine  is  broken 
(H22/1000) . 

The  purpose  of  the  control  matrices  was  to  check  the  possibility  that 
subjects  who  are  given  information  from  both  full  and  spot  checks  might  simply 
Ignore  that  from  spot  checks.  -identic  ds  did  not  happen.  In  both  matrices 
there  were  significant  effects  fo~  he  ijw  factor  (F(l,40)  -  15.31  and  20.75 
for  L  and  H,  respectively)  as  well  as  for  the  column  factor  (F(l,40)  «  10.91 
and  18.2).  Neither  matrix  had  a  significant  interaction. 


The  four  critical  matrices  are  those  in  which  nonadditivity  (i.e., 
crossovers)  might  have  been  expected  to  occur.  It  is  evident  from  the  graphs 
that,  at  least  at  the  group  level,  the  data  are  ordinally  additive.  Although 
three  of  the  four  matrices  had  significant  interactions  of  the  form  generally 
expected  (F(1,4Q)  *  34.85,  4.46,  and  5.60  for  LI,  L2,  and  1C  ,  respectively), 
the  curves  for  the  spot  check  data  would  have  actually  had  to  cross  over  the 
curves  for  the  full  check  data  for  nonadditivity  to  hold. 

Since  differential  weighting  permits  nonadditivity  but  does  not  require 
it,  it  is  possible  that  nonadditivity  might  have  held  for  some  subjects  but 
not  all.  To  test  this,  the  data  from  the  single  subjects  were  averaged  Indivi¬ 
dually  over  replications  and  checked  for  ordinal  interactions.  The  results 
are  given  in  Table  1.  Column  2  gives  the  number  of  subjects  (out  of  41)  who 
were  additive  for  each  of  the  matrices.  Column  3  gives  the  number  of  subjects 
who  showed  the  expected  "averaging  type"  of  nonadditivity  in  which  the  steeper 
slope  of  the  curve  for  the  "weaker"  evidence  causes  it  to  cross  over  the 
shallower  slope  of  the  curve  for  the  "stronger"  evidence.  (Note  that  no  cross¬ 
overs  were  actually  predi  -ted  for  the  Control  matrices.  Nevertheless, 
averaging-type  crossovers  can  occur  if  the  weights  for  samples  vary  with  diag- 
nosticity.)  Column  3  gives  the  number  of  subjects  who  showed  forms  of  non¬ 
additivity  other  than  the  expected  one. 

It  is  evident  from  the  data  that  despite  an  overall  tendency  to  additivity 
there  were  numerous  violations  of  additivity  at  the  single  subject  level, 
averaging  2.5  violations  per  subject  out  of  6  tests.  No  subjects  had  zero 
violations  and  only  11  subjects  had  as  few  as  one.  However,  the  violations 
were  not  restricted  to  the  expected  form,  nor  were  they  restricted  to  the 
critical  matrices  in  which  differential  weighting  effects  should  have  been 
maximized.  Thus,  Experiment  1  does  not  provide  a  clear  answer  concerning 
additivity.  At  the  group  level,  the  data  satisfy  additivity,  although  this 
additivity  is  not  particularly  well  supported  by  single  subject  analyses. 

At  the  single  subject  level,  there  are  numerous  instances  of  nonadditivity, 
although  these  are  often  of  an  unexpected  form.  With  only  two  replications 
per  data  point,  it  is  not  possible  to  tell  whether  these  unexpected  forms  of 
nonadditivity  are  simply  noise  or  whether  they  reflect  some  unanticipated 
but  systematic  aspect  of  the  judgment  process. 

Experiment  2  was  Intended  to  Improve  on  Experiment  1  In  three  ways. 

First,  In  order  to  increase  the  reliability  of  single  subject  tests  of  addi¬ 
tivity,  replications  were  increased  from  two  to  four.  Second,  In  order  to 


Table  1 


Experiment  1 
Single  subject  tests 
of  additivity 


iatrlx 

Additive 

Responses 

Averaging-type 
Nonadditive  responses 

Other 

Nonadditive  responses 

Control  L 

17 

10 

14 

Critical  LI 

26 

9 

6 

Critical  L2 

21 

8 

12 

Control  H 

25 

7 

9 

Critical  HI 

24 

6 

11 

Critical  H2 

29 

6 

6 

Totals 


142 


46 


58 
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enhance  potential  weighting  differences  between  full  checks  and  spot  checks, 
a  three-stimulus  design  was  used  in  which  one  factor  comprised  single  samples 
and  the  other  factor  comprised  pairs  of  samples.  Third,  in  order  to  provide 
an  estimate  of  the  rate  at  which  nonadditivities  occur  due  to  subject  error, 
control  matrices  were  developed  in  which  additivity  would  be  expected  to  hold 
for  any  process  in  which  the  final  response  is  simply  a  weighted  average  of 
sample  information. 
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Experiment  2 


Method 

Task  and  design.  The  task  for  Experiment  2  was  exactly  like  that  for 
Experiment  1  except  that  judgments  were  based  on  three  samples  per  trial  rather 
than  two.  The  various  stimulus  triples  were  constructed  using  a  two-factor 
design  in  which  the  column  levels  were  all  pairs  of  samples  and  the  row  levels 
were  all  single  samples. 

The  design  can  be  partitioned  into  eight  2x2  matrices,  all  of  which 
have  both  spot  checks  and  full  checks  on  each  factor.  These  are  shown  in 
Figure  4.  The  four  matrices  shown  in  the  upper  panel  (two  with  high  values 
and  two  with  low  values)  are  the  Critical  matrices  in  which  nonaddltivlty  can 
occur  given  particular  assignments  of  weights  and  scale  values.  For  illus¬ 
tration,  the  values  shown  in  the  figure  arise  when  (a)  the  scale  values  are 
taken  to  be  numerically  equal  to  the  sample  values  and  (b)  the  weights  for 
full  and  spot  checks  are,  respectively,  3  and  1.  Note  that  the  upper  pair  of 
critical  matrices  show  crossovers  whereas  the  lower  pair  show  convergence  but 
no  crossovers.  This  difference  between  matrices  reflects  the  particular 
"timing"  of  weight  and  scale  value  magnitudes.  When  the  weights  are  2  to  1, 
none  of  the  four  critical  matrices  has  crossovers.  At  5  to  1,  the  lower 
two  critical  matrices  have  crossovers  but  the  upper  two  do  not.  At  10  to  1, 
none  of  the  critical  matrices  has  crossovers. 

The  four  control  matrices  in  the  lower  panel  are  of  interest  because  for 
these  matrices  violations  of  additivity  cannot  occur  if  the  response  is  any 
weighted  average  of  sample  information.  This  is  because  the  scale  values 
within  each  factor  are  identical.  Under  this  condition  it  can  be  shown  that 
the  predicted  value  (l.e,,  the  weighted  average)  varies  as  a  linear  function 
of  the  relative  weight  ratio  in  a  given  cell,  and  such  ratios  display  ordinal 
independence.  Thus,  the  occurrence  of  nonadditivity  in  control  matrices  will 
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CRITICAL  MATRICES 


LI 

Full  11 
Full  11 

Spot  11 
Spot  11 

HI 

"ULL  21 
Full  21 

Spot  21 
Spot  21 

Full  13 

11.7 

12.2 

Full  19 

20.3 

19.8 

Spot  15 

11.6 

12.3 

Spot  17 

20. A 

19.7 

L2 

Full  11 
Full  12 

Spot  11 
Spot  12 

H2 

Full  21 
Full  20 

Spot  21 
Spot  10 

Full  13 

12.0 

12. A 

Full  19 

20.0 

19.6 

Spot  15 

12.0 

12.7 

Spot  17 

20.0 

19.3 

CONTROL  MATRICES 


LI 

Full  11 
Full  11 

Spot  11 
Spot  11 

HI 

Full  21 
Full  21 

Spot  21 
Spot  21 

Full  1A 

12.0 

12.8 

Full  18 

20.0 

19.2 

Spot  1A 

11. A 

12.0 

Spot  18 

20.6 

20.0 

L2 

Full  11 
Full  12 

Spot  11 
Spot  12 

H2 

Full  21 
Full  20 

Spot  21 
Spot  20 

Full  1A 

12.3 

13.0 

Full  18 

19.7 

19.0 

Spot  1A 

11.9 

12.3 

Spot  18 

20.1 

19.7 

Figure  A,  Stimulus  design  and  illustrative  data  for  Experiment  2. 
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Indicate  either  (a)  the  base  rate  of  crossovers  due  to  subject  unreliability 
or  (b)  other  factors  not  accounted  for  by  simply  averaging  sample  Information. 

Procedure .  The  procedure  for  Experiment  2  was  essentially  the  same  as 
that  for  Experiment  1  except  for  differences  in  the  stimulus  display.  The 
stimulus  triples  were  displayed  In  a  linear  format.  In  every  case  the  single 
sample  from  the  row  factor  was  Inserted  between  the  pair  of  samples  from  the 
column  factor.  For  example,  the  stimulus  triple  shown  In  the  lower-left  cell 
of  Critical  matrix  LI  would  have  been  displayed  as: 

FULL  CHECK  11 
SPOT  CHECK  (15) 

FULL  CHECK  11 

As  before,  subjects  were  run  Individually.  The  session  lasted  about  one 
hour  with  a  five  minute  break  in  the  middle.  There  were  15  trials  for  practice. 
These  were  followed  by  four  replications  of  the  experimental  matrices.  Stimulus 
triples  were  ordered  randomly  within  replication  so  that  no  triples  from  the 
same  matrix  appeared  In  sequence.  Counting  fillers  and  anchors,  there  were 
175  trials  in  all. 

Subjects.  Subjects  were  26  student  volunteers  from  the  University  of 
Wisconsin — Madison  who  participated  for  pay. 

Results  and  Discussion 

The  results  of  Experiment  2  are  In  Figure  5.  Critical  matrices  are  in 
the  upper  panel  and  control  matrices  are  in  the  lower  panel.  Judgments  have 
been  scored  so  that  0  represents  certainty  that  the  machine  is  normal  (H10/1000) 
and  1  represents  certainty  that  the  machine  is  broken  (H22/1000) .  The  graphs 
for  the  critical  matrices  have  the  same  general  shape  as  the  analogous  matrices 
in  Experiment  1.  There  were  significant  column  effects  for  all  four  matrices 
(with  F(l,25)  ranging  from  20.7  to  56.5)  and  significant  row  effects  (with 
F(l,25)  from  7.6  to  16.8)  for  all  matrices  except  L2.  Contrary  to  the  case  for 
Experiment  1,  however,  the  Interactions  for  these  matrices  did  not  reach 
statistical  significance. 

Of  the  control  matrices,  all  had  significant  column  effects  (with  F(l,25) 
ranging  from  19.2  to  32.9).  Row  effects  were  significant  only  for  LI  and 
L2  (F(l,25)  ■  30.3  and  13.3).  The  only  significant  interaction  effect  was  for 
U  (F(l,25)-  6.6). 
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In  general,  then,  the  group  data  do  not  violate  ordinal  additivity. 
However,  tests  of  additivity  at  the  single  subject  level  revealed  about  the 
same  level  of  nonadditivity  as  was  found  in  Experiment  1.  The  mean  number 
of  nonadditive  tests  was  3.1  per  subject  and  the  median  was  4.  Only  two  sub¬ 
jects  were  additive  on  all  8  tests.  Since  these  data  were  based  on  averages 
over  four  replications,  it  does  not  appear  likely  that  they  are  simply 
noise. 

The  results  of  the  single  subject  tests  are  summarized  in  Table  2. 

All  together,  there  were  208  tests,  104  each  for  critical  and  control  matrices. 
The  proportions  of  additive  tests  were  virtually  identical  for  both  matrix 
types,  63%  and  61%,  respectively.  As  before,  reasonably  many  nonadditivities 
of  the  expected  averaging  type  (14%)  occurred  for  critical  matrices. 

However,  almost  as  many  of  these  nonadditivities  (11%)  occurred  for  control 
matrices.  Furthermore,  numerous  nonadditivities  of  other  types  occurred  for 
both  critical  (23%)  and  control  matrices  (29%)  . 

Classification  of  the  individual  nonaddltivltles  suggested  that  they 
were  predominately  of  three  types.  (In  general,  four  cell  means  can  be 
arranged  in  24  different  orders,  8  of  which  are  additive  and  16  of  which  are 
nonadditive.)  First,  of  course,  are  the  averaging-type  nonadditivities  in 
which  the  slope  for  the  "weaker"  evidence  is  steeper  than  the  slope  for  the 
"stronger"  evidence.  The  second  type  reverses  this  pattern  in  that  the 
slope  for  the  "stronger"  evidence  is  the  steeper  of  the  two.  The  third  type 
has  a  fan  shape  in  which  tiro  curves  whose  slopes  differ  in  sign  fan  out  from 
a  common  (or  near-common)  point.  The  various  numbers  of  these  unexpected 
types  of  nonaddlt ivity  are  given  in  the  fourth  and  fifth  columns  of  Table  2  and 
idealizations  of  all  three  nonadditive  patterns  are  given  in  Figure  6. 

Inspection  of  the  single  subject  data  suggested  that  these  types  of 
nonadd it ivities  were  characteristic  of  particular  subjects  and  not  uniformly 
distributed  among  subjects  (see  breakdown  in  Table  3).  Although  there  are 
not  sufficient  data  to  test  the  possibility,  it  appears  that  the  subjects  may 
have  differed  qualitatively  from  one  another  in  the  way  that  they  performed 
the  present  task.  Thus,  the  additive  picture  of  the  Inference  process  revealed 
in  the  group  data  may  have  been,  to  some  degree  at  least,  created  by  averaging 
over  subjects  who  used  different  judgment  strategies.  What  these  strategies 
were,  however,  is  not  certain,  although  reasonable  speculations  can  be  made 
about  two  of  the  patterns.  These  are  given  in  the  next  section. 
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General  Discussion 

The  two  reported  experiments  leave  considerable  ambiguity  about  whether 
human  inference  processes  are  better  characterized  as  additive  or  nonadditive. 

On  the  one  hand,  there  were  numerous  instances  of  nonadditivity  in  the  single 
subject  data,  far  beyond  the  number  that  one  would  ordinarily  find  in  "good" 
additive  data.  On  the  other  hand,  the  non additivities  that  occurred  were  often 
found  in  unexpected  places  and  with  unexpected  patterns.  Thus,  it  would  be 
desirable  to  know  whether  these  nonadditivities  make  psychological  sense. 

In  this  section,  I  will  speculate  on  why  nonadditivity  occurred  in  the 
control  matrices  of  Experiment  2  as  well  as  in  the  test  matrices,  and  why 
reverse-type  nonadditivities  occurred  for  at  least  some  subjects  instead  of 
averaging- type  nonadditivities.  Since  the  psychological  theme  underlying 
the  present  research  concerned  the  role  of  serial  adjustment  in  judgment, 
these  speculations  will  be  couched  in  terms  of  adjustment  processes  rather  than 
in  terms  of  algebra.  I'll  begin  by  summarizing  a  general  procedural  theory  of 
algebraic  judgment  that  was  presented  more  completely  in  Lopes  (1982).  Then  I'll 
show  how  this  theory  applies  in  the  present  case. 

Figure  7  outlines  the  major  steps  that  are  hypothesized  to  occur  during 
judgment.  In  the  scanning  step  the  judge  quickly  assesses  the  information  that 
has  been  presented  for  judgment.  On  the  basis  of  the  initial  scan,  the  judge 
is  hypothesized  to  select  an  item  to  use  as  an  anchor  point .  This  anchor  stimulus 
will  generally  be  chosen  because  it  seems  relatively  more  important  than  the 
other  available  items. 

Once  an  anchor  is  chosen,  it  is  evaluated  relative  to  the  scale  of  judgment. 
This  "valuation"  operation  may  yield  a  quantity  that  serves  directly  as  the 
Initial  judgment.  For  example,  in  Bayesian  tasks  such  as  the  present  one,  sub¬ 
jects  may  simply  anchor  their  judgment  at  the  value  given  by  the  number  of 
rejects  in  the  anchor  stimulus  (Lopes,  1981).  In  other  cases,  however,  the 
anchor  point  may  be  a  somewhat  less  extreme  compromise  between  the  value  of  the 
stimulus  Information  and  the  value  of  a  neutral  "initial  impression"  (Anderson, 
1967) . 

If  after  anchoring  there  are  still  other  items  to  be  considered,  the  pro¬ 
cess  reiterates  with  the  judge  choosing  which  of  the  remaining  stimuli  to 
consider  next.  This  stimulus  is  Integrated  into  the  judgment  by  adjusting 
the  initial  value  according  to  the  new  Information.  It  is  this  step  that  is 
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Figure  7.  Flow  diagram  of  proposed  serial  adjustment  judgment  mechanism. 
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most  critical  In  determining  the  algebraic  form  of  the  overall  judgment. 

In  averaging  processes,  generally,  adjustment  is  assumed  to  comprise  two 
stages:  (1)  location  of  the  new  Information  on  the  judgment  scale  relative 

to  the  old  information,  and  (2)  adjustment  of  the  old  judgment  value  toward 
the  new  Information  to  produce  a  new  judgment  value  that  lies  between  the 
two.  This  adjustment  process  then  repeats  until  all  the  available  informa¬ 
tion  has  been  used  or  until  the  subject  judges  that  enough  Information  has 
been  processed. 

Now  let  us  consider  how  the  hypothesized  serial  adjustment  process  can 
lead  to  nonadditivities.  The  following  five  assumptions  will  be  helpful  In 
laying  out  the  general  form  of  the  proposed  explanation. 

1.  If  a  stimulus  pair  contains  both  full  check  information  and  spot 
check  information,  the  full  check  information  will  be  used  to  provide 
the  judgmental  anchor. 

2.  If  a  stimulus  pair  contains  all  full  check  information  or  all  spot 
check  information.  Information  that  is  duplicated  will  be  used  to 
provide  the  judgmental  anchor. 

3.  If  duplicated  information  is  used  to  provide  the  judgmental  anchor, 
there  will  be  no.  further  use  of  the  duplicate  Information  in  the 
judgment. 

The  first  two  of  these  assumptions  are  straightforward  and  fairly  obvious 
approaches  to  specifying  which  stimulus  information  will  be  used  to  anchor  the 
judgment.  The  third  assumption  is  made  for  convenience  so  that  problems  of 
specifying  whether  and  how  adjustments  are  made  when  the  "new"  Information  is 
the  same  as  the  "old"  information  can  be  avoided.  It  should  be  noted,  however, 
that  this  assumption  is  not  critical  mathematically. 

4.  In  situations  in  which  both  the  anchor  stimulus  and  the  adjustment 
stimulus  have  the  same  status  (i.e.,  both  full  checks  or  both  spot 
checks),  the  adjustment  will  be  to  a  position  halfway  between  the 
anchor  value  and  the  value  of  the  adjustment  stimulus. 

5.  In  situations  in  which  the  anchor  stimulus  and  the  adjustment  stimulus 
have  different  status  (i.e.,  the  anchor  is  a  full  check  and  the  adjust¬ 
ment  stimulus  is  a  spot  check),  the  adjustment  will  be  to  a  position 
one  fifth  of  the  way  between  the  anchor  value  and  the  value  of  the 
adjustment  stimulus. 

Thes^  latter  two  assumptions  merely  provide  numerical  values  that  can  be  used  to 
Illustrate  how  differential  weighting  in  the  serial  adjustment  model  produces 
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nonadditivity  in  a  particular  data  set.  Thus,  they  function  only  to  illustrate 
relationships  that  might  obtain  for  a  given  subject  or  a  given  experiment,  not 
relationships  that  must  obtain  in  general. 

Figure  8  shows  how,  given  the  five  assumptions,  the  serial  adjustment  pro¬ 
cess  produces  the  form  of  nonadditivity  that  I  have  termed  "averaging-type". 

The  letters  at  the  end  of  each  of  the  four  "scales"  refer  to  the  labels  on  the 
four  data  points  of  the  idealized  graph  in  the  top  panel  of  Figure  6.  For 
Point  A,  the  subject  anchors  (*A)  on  the  value  given  by  the  duplicated  FULL  CHECK 
11  samples.  Then  a  single  adjustment  is  made  to  account  for  the  FULL  CHECK  13 
sample.  Since  both  the  anchor  stimulus  and  the  adjustment  stimulus  are  full  checks, 
the  final  value  is  12,  halfway  between  the  two  values.  For  Point  B  the  subject 
anchors  at  the  same  point  but  the  adjustment  is  made  to  the  SPOT  CHECK  IS  sample. 
Note  that  despite  the  fact  that  the  scale  value  "15"  is  further  from  "11"  than 
is  the  scale  value  "13",  the  final  judgment  for  Point  B  is  actually  less  than  the 
judgment  for  Point  A  due  to  the  proportionally  smaller  adjustment  (1/5  versus  1/2) 
that  occurs  when  spot  check  data  is  Integrated  into  full  check  data. 

For  Point  C,  there  are  two  identical  spot  checks  and  a  single  full  check. 
According  to  the  first  assumption,  the  judgment  is  anchored  at  the  value  for 
FULL  CHECK  13.  Following  this  there  are  two  adjustments  made  for  the  SPOT  CHECK 
11  Information.  The  first  of  these  goes  1/5  of  the  distance  between  13  and  11, 
yielding  an  interim  result  of  about  12.6,  then  the  second  of  these  goes  1/5  of  the 
distance  between  the  interim  value  and  11,  leaving  a  final  response  of  about  12.3. 
For  Point  D,  the  anchor  is  given  by  the  duplicated  SPOT  CHECK  11  samples  and  the 
adjustment  is  for  the  single  SPOT  CHECK  15.  This  yields  a  final  value  of  13 
which.  Importantly,  is  larger  than  the  final  value  for  Point  C.  Thus,  the  simple 
serial  adjustment  model  produces  a  pattern  of  nonadditivity  with  B<A<C<D.  This 
is  exactly  the  averaging-type  nonadditivity  that  is  described  algebraically  in 
Figure  1  and  illustrated  graphically  in  the  top  panel  of  Figure  6. 

A  problem,  however,  arises  with  respect  to  the  control  matrices.  Given 
the  set  of  processing  assumptions  above,  it  can  easily  be  shown  that  there  is  no 
weighting  scheme  applied  solely  to  scale  values  that  can  lead  to  nonadditivities 
if  the  scale  values  within  a  given  factor  are  the  same.  Nevertheless,  nonadditi¬ 
vities  are  possible  within  the  serial  adjustment  model  if  it  is  assumed  (1)  that 
the  subject  has  a  neutral  "initial  impression"  with  a  non-zero  weight  and  (2)  that 
the  effective  anchor  point  in  a  judgment  is  actually  a  weighted  average  of  the 
initial  Impression  and  the  stimulus  Information  that  is  selected  by  the  initial 
scanning  operation.  Since  there  is  good  reason  to  believe  that  initial  impressions 


24 


commonly  Influence  judgments  in  this  way  (cf.  Anderson,  1974,  1981),  it  is 
useful  to  see  how  they  might  operate  in  the  present  task. 

The  top  four  scales  of  Figure  9  show  how  the  serial  adjustment  model  would 
operate  on  critical  (top  panel)  and  control  matrices  (bottom  panel)  if  there 
were  a  neutral  initial  impression.  For  the  sake  of  simplicity,  the  anchor  values 
for  Points  A,  B,  and  C  in  both  panels  are  drawn  exactly  as  they  were  in  Figure  8. 
This  would  be  approximately  correct  if  the  weight  for  full  checks  was  very  much 
greater  than  the  weight  for  the  Initial  impression.  What  is  important  is  that  the 
anchor  value  for  Point  D  in  each  panel  is  drawn  as  being  more  neutral  (i.e., 
larger  in  this  case)  than  is  the  analogous  value  for  Point  D  in  Figure  8.  This 
difference  in  position  reflects  the  fact  that  the  relative  weight  of  the  neutral 
initial  impression  is  higher  compared  to  the  weight  of  spot  check  Information 
than  compared  to  the  weight  of  full  check  information.  Thus,  the  anchor  position 
for  Point  D  is  shifted  toward  a  more  neutral  position. 

Note  that  the  qualitative  effect  of  the  initial  impression  is  to  produce 
an  identical  pattern  of  nonadditivity  in  both  panels.  Thus,  there  is  at  least 
weak  support  for  the  hypothesis  that  a  differentially  weighted  averaging  model 
with  an  initial  impression  can  account  for  averaging-type  nonadditivities  in 
either  critical  or  control  matrices.  Can  a  differentially  weighted  averaging  pro¬ 
cess  also  explain  the  other  observed  patterns  of  nonadditivity?  For  the  reverse- 
type  pattern  (middle  panel  of  Figure  6)  the  answer  is  "no".  The  pattern  can  be 
explained,  however,  if  we  assume  that  some  subjects  make  adjustments  that  are  direc¬ 
tionally  in  accord  with  the  Bayesian  model.  To  see  how  this  might  work,  consider 
how  such  subjects  would  differ  from  subjects  who  follow  an  averaging-type  rule. 

The  essence  of  the  averaging  model  is  that  adjustments  to  the  anchor  position 
are  always  in  the  direction  of  the  value  of  the  new  information.  Thus,  if  it 
happens  that  both  pieces  of  evidence  support  the  same  hypothesis  and  if,  for  what¬ 
ever  reasons,  the  evidence  that  is  used  to  anchor  the  judgment  is  the  more  extreme 
of  the  two,  then  it  follows  that  the  adjustment  process  will  be  toward  neutral. 

Under  Bayes'  theorem,  however,  the  adjustment  would  be  toward  greater  extremity. 
Thus,  subjects  whose  adjustments  are  in  the  Bayesian  direction  would,  for  any 
stimulus  pairs  in  which  both  stimuli  favor  the  same  hypothesis,  always  adjust  from 
the  anchor  position  toward  a  more  extreme  response,  no  matter  in  what  order  the 
stimuli  were  processed. 

Since  previous  tests  of  the  serial  adjustment  model  (Lopes,  1980,  1981)  have 
shown  that  some  subjects  do  make  Bayesian-type  adjustments  when  stimuli  are  pre¬ 
sented  sequentially,  it  is  not  unreasonable  to  suppose  that  some  subjects  in  the 
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Figure  9.  Serial  adjustment  mechanism  with  averaging- type  adjustments  and 
Initial  impression. 
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present  experiments  might  also  hsve  made  Bayesian-type  adjustments.  Figure  10 
shows  how  subjects  making  such  adjustments  might  produce  reverse-type  nonadditi¬ 
vities.  For  illustration,  consider  the  upper  panel.  The  judgment  labeled 
Point  A  is  anchored  by  the  FULL  CHECK  11  samples  and  is  then  adjusted  leftward 
(toward  the  hypothesis  that  the  machine  is  normal)  to  account  for  the  FULL 
CHECK  13  sample  that  also  favors  the  machine  being  normal.  The  anchor  for 
Point  B  is  the  same,  but  the  adjustment  is  smaller  due  to  the  fact  that  a  spot 
check  of  15  favors  the  machine's  being  normal  considerably  less  than  a  full 
check  of  13.  Point  C  is  anchored  at  FULL  CHECK  13  and  then  adjusted  leftward 
twice  in  accord  with  the  two  SPOT  CHECK  11  samples.  These  adjustments  are 
somewhat  smaller  than  the  adjustment  for  the  FULL  CHECK  13  shown  on  the  top  line 
since  they  are  based  on  less  reliable  information  than  the  anchor  value  that 
they  are  adjusting.  Lastly,  the  SPOT  CHECK  11  values  are  used  to  anchor  Point  D 
at  "12",  which  is  a  less  extreme  position  than  is  produced  by  equivalent  informa¬ 
tion  from  full  checks.  This  is  then  adjusted  to  account  for  the  additional 
Information  provided  by  the  SPOT  CHECK  15  sample.  I  have  shown  this  adjustment 
to  be  somewhat  larger  than  the  adjustments  for  SPOT  CHECK  11  on  the  line  above 
since  it  is  adjusting  an  anchor  stimulus  of  equal  reliability.  The  final  result 
is  that  A<B<D<C.  Thus,  a  serial  adjustment  strategy  that  differs  from  the 
averaging  strategy  primarily  in  terms  of  the  direction  of  adjustments  can  produce 
the  reverse- type  of  nonadditlvlty  that  was  observed  to  occur  in  the  data. 

It  appears,  then,  that  a  differentially  weighted  serial  adjustment  model 
can  account  for  two  of  the  major  kinds  of  nonadditivity  found  in  the  data. 
However,  the  prevalence  of  fan-type  nonadditivities  in  the  data  is  problematical 
since  there  does  not  appear  to  be  any  simple  way  in  which  a  serial  adjustment 
mechanism  could  account  for  the  negative  slope  of  the  curve  for  spot  checks. 

Thus,  although  there  does  appear  to  be  reasonable  support  for  the  conclusion 
that  the  process  people  use  in  Bayesian  tasks  is  more  likely  to  be  nonadditive 
than  additive,  it  is  not  immediately  apparent  that  the  kind  of  serial  adjust¬ 
ment  strategy  examined  here  can  account  for  all  the  data. 


TEST  TRIALS 


27 


/O'" 

Point 

a  _  . 

11 

*A  Fll 

_ >DS15 _ 

Point 

— - a - ■  « 

11 

*A  Fll 

- r  w  —  - 

Sll  Sll 

on  - 

- 1 - 

Point 

11 

13 

• - -  —  ■  — 

11 

*A  F13 

£S _ _ 

12 

Point 

. .  t  -  . 

*A  Sll 


CONTROL  TRIALS 


?Q±nt  A 


- 1 - X - 1 - - - 

11 

*A  Fll 

_ .  Osu  , 

- 1 - «  —  .. 

Point  B 

11 

*A  Fll 

Sll  Sll 

Point  C 

11 

dCT  ■ 

iJ 

*A  F14 

Point  C 

11 

12 

*A  Sll 

Figure  10.  Serial  adjustment  mechanism  with  Bayes Ian- type  adjustments 

and  Initial  lmpre8slon. 


References 


Anderson,  N.  H.  Averaging  model  analysis  of  set-size  effect  in  Impression 
formation.  Journal  of  Experimental  Psychology,  1967,  158-165. 

Anderson,  N.  H.  Foundations  of  information  integration  theory.  New  York: 
Academic  Press,  1981. 

Anderson,  N.  H.  Information  integration  theory:  A  brief  survey.  In  D.  H. 
Krantz,  R.  C.  Atkinson,  R.  D.  Luce,  &  P.  Suppes  (Eds.),  Contemporary 
developments  in  mathematical  Psychology,  Volume  2.  San  Francisco:  W.  H 
Freeman,  1974. 

Einhom,  H.  J.,  &  Hogarth,  R.  H.  A  theory  of  diagnostic  inference: 

I.  Imagination  and  the  psychophysics  of  evidence.  Technical  report. 
University  of  Chicago  Graduate  School  of  Business,  June  1982. 

Krantz,  D.  H.,  Luce,  R.  D.,  Suppes,  P.,  &  Tversky,  A.  Foundations  of  measure 
ment.  Vol.  I;  Additive  and  polynomial  representations.  New  York: 
Academic  Press,  1971. 

Lopes,  L.  L.  Averaging  rules  and  adjustment  processes:  The  role  of  averaging 
in  Inference.  Technical  report,  Wisconsin  Human  Information  Processing 
Program  (WHIPP  13),  Madison,  WI,  December  1981. 

Lopes,  L.  L.  Procedural  debiasing.  Technical  report,  Wisconsin  Human 

Information  Processing  Program  (WHIPP  14),  Madison,  WI,  October  1982. 

Lopes,  L.  L.,  &  Johnson,  M.  D.  Judging  similarity  among  strings  described 
by  hierarchical  trees.  Acta  Psychologica,  1982,  51,  13-26. 

Lopes,  L.  L.,  &  Oden,  G.  C.  Comparison  of  two  models  of  similarity  judgment. 
Acta  Psychologica,  1980,  _46,  205-234. 

Shanteau,  J.  C.  An  additive  model  for  sequential  decision  making.  Journal  of 
Experimental  Psychology,  1970,  J55,  181-191. 

Shanteau,  J.  C.  Averaging  versus  multiplying  combination  rules  of  Inference 
judgment.  Acta  Psychologica.  1975,  39,  83-89. 

Shanteau,  J.  C.  Descriptive  versus  normative  models  of  sequential  inference 
judgment.  Journal  of  Experimental  Psychology,  1972,  93.  63-68. 

Tversky,  A.,  &  Kahneman,  D.  Judgment  under  uncertainty:  Heuristics  and  biases. 
Science.  1974,  185,  1124-1131. 

Wallsten,  T.  S.  A  note  on  Shanteau's  'Averaging  versus  multiplying  combination 
rules  of  inference  judgment.'  Acta  Psychologica.  1976,  40,  325-330.  (a) 


Wallsten,  T.  S.  Conjoint-measurement  framework  for  the  study  of  probabilistic 
information  processing.  Psychological  Review.  1972,  79.  245-260. 
Wallsten,  T.  S.  Using  conjoint-measurement  methods  to  investigate  a  theory 
about  probabilistic  information  processing.  Journal  of  Mathematical 
Psychology.  1976,  14,  144-185.  (b) 


* 


30 


r-iv. 

I1'/ 


| 


L"  - 

i-Y 

yV 

$ 


DISTRIBUTION  LIST 


OSD 

CAPT  Paul  R.  Chatelier 
Office  of  the  Deputy  Under  Secretary 
of  Defense 
OUSDRE  (E&LS) 

Pentagon,  Room  3D129 
Washington,  D.  C.  20301 

Dr.  Dennis  Leedom 

Office  of  the  Deputy  Under  Secretary 
of  Defense  (C^l) 

Pentagon 

Washington,  D.  C.  20301 

Department  of  the  Navy 

Engineering  Psychology  Group 
Office  of  Naval  Research 
Code  442  EP 

Arlington,  VA  22217  (2  cys.) 

Aviation  &  Aerospace  Technology 
Programs 
Code  210 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Communication  &  Computer  Technology 
Programs 
Code  240 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Physiology  &  NeuroBiology  Programs 
Code  441NB 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Tactical  Development  &  Evaluation 
Support  Programs 
Code  230 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 


Department  of  the  Navy 

Manpower,  Personnel  &  Training 
Programs 
Code  270 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Mathematics  Group 
Code  411-MA 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Statistics  and  Probability  Group 
Code  411-S&P 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Information  Sciences  Division 
Code  433 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

CDR  K.  Hull 
Code  230B 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Special  Assistant  for  Marine  Corps 
Matters 
Code  100M 

Office  of  Naval  Research 
800  North  Quincy  Street 
Arlington,  VA  22217 

Dr.  J.  Lester 
ONR  Detachment 
495  Summer  Street 
Boston,  MA  02210 

Mr.  R.  Lawson 
ONR  Detachment 
1030  East  Green  Street 
Pasadena,  CA  91106 


31 


Department  of  the  Navy 

CDR  James  Offutt,  Off leer- in-Charge 
ONR  Detachment 
1030  East  Green  Street 
Pasadena,  CA  91106 

Director 

Naval  Research  Laboratory 
Technical  Information  Division 
Code  2627 

Washington,  D.  C.  20375 

Dr.  Michael  Melich 
Communications  Sciences  Division 
Code  7500 

Naval  Research  Laboratory 
Washington,  D.  C.  20375 

Dr.  J.  S.  Lawson 

Naval  Electronic  Systems  Command 

NELEX-06T 

Washington,  D.  C.  20360 

Dr.  Robert  E.  Conley 

Office  of  Chief  of  Naval  Operations 

Command  and  Control 

OP-094H 

Washington,  D.  C.  20350 

CDR  Thomas  Berghage 

Naval  Health  Research  Center 

San  Diego,  CA  92152 

Dr.  Robert  G.  Smith 
Office  of  the  Chief  of  Naval 
Operations,  OP987H 
Personnel  Logistics  Plans 
Washington,  D.  C.  20350 

Dr.  Andrew  Rechnitzer 
Office  of  the  Chief  of  Naval 
Operations,  OP952F 
Naval  Oceanography  Division 
Washington,  D.  C.  20350 

Combat  Control  Systems  Department 
Code  35 

Naval  Underwater  Systems  Center 
Newport,  RI  02840 


Department  of  the  Navy 

Human  Factors  Department 
Code  N-71 

Naval  Training  Equipment  Center 
Orlando,  FL  32813 

Dr.  Alfred  F.  Smode 
Training  Analysis  and  Evaluation 
Group 

Orlando,  FL  32813 

CDR  Norman  E.  Lane 
Code  N-7A 

Naval  Training  Equipment  Center 
Orlando,  FL  32813 

Dr.  Gary  Poock 

Operations  Research  Department 
Naval  Postgraduate  School 
Monterey,  CA  93940 

Dean  of  Research  Administration 
Naval  Postgraduate  School 
Monterey,  CA  93940 

Mr.  H.  Talklngton 
Ocean  Engineering  Department 
Naval  Ocean  Systems  Center 
San  Diego,  CA  92152 

Mr.  Paul  Heckman 

Naval  Ocean  Systems  Center 

San  Diego,  CA  92152 

Dr.  Ross  Pepper 

Naval  Ocean  Systems  Center 

Hawaii  Laboratory 

P.  0.  Box  997 

Kailua,  HI  96734 

Dr.  A.  L.  Slafkosky 
Scientific  Advisor 
Commandant  of  the  Marine  Corps 
Code  RD-1 

Washington,  D.  C.  20380 

Dr.  L.  Chmura 

Naval  Research  Laboratory 

Code  7592 

Computer  Sciences  &  Systems 
Washington,  D.  C.  20375 


Department  of  the  Navy 

HQS,  U.  S.  Marine  Corps 
ATTN:  CCA40  (Major  Pennell) 
Washington,  D.  C.  20380 

Commanding  Officer 
MCTSSA 

Marine  Corps  Base 

Camp  Pendleton,  CA  92055 

Chief,  C^  Division 
Development  Center 
MCDEC 

Quant ico,  VA  22134 

Human  Factors  Technology  Administrator 

Office  of  Naval  Technology 

Code  MAT  0722 

800  N.  Quincy  Street 

Arlington,  VA  22217 

Commander 

Naval  Air  Systems  Command 
Human  Factors  Programs 
NAVAIR  334A 

Washington,  D.  C.  20361 
Commander 

Naval  Air  Systems  Command 
Crew  Station  Design 
NAVAIR  5313 

Washington,  D.  C.  20361 

Mr.  Philip  Andrews 
Naval  Sea  Systems  Command 
NAVSEA  03416 
Washington,  D.  C.  20362 

Commander 

Naval  Electronics  Systems  Command 
Human  Factors  Engineering  Branch 
Code  81323 

Washington,  D.  C.  20360 
Larry  Olmstead 

Naval  Surface  Weapons  Center 

NSWC/DL 

Code  N-32 

Dahlgren,  VA  22448 


Department  of  the  Navy 
Mr.  Milon  Essoglou 

Naval  Facilities  Engineering  Command 
R  &  D  Plans  and  Programs 
Code  03T 

Hoffman  Building  II 
Alexandria,  VA  22332 

CDR  Robert  Biersner 
Naval  Medical  R  &  D  Command 
Code  44 

Naval  Medical  Center 
Bethesda,  MD  20014 

Dr.  Arthur  Bachrach 
Behavioral  Sciences  Department 
Naval  Medical  Research  Institute 
Bethesda,  MD  20014 

Dr.  George  Moeller 
Human  Factors  Engineering  Branch 
Submarine  Medical  Research  Lab 
Naval  Submarine  Base 
Groton,  CT  06340 

Head 

Aerospace  Psychology  Department 
Code  L5 

Naval  Aerospace  Medical  Research  Lab 
Pensacola,  FL  32508 

Commanding  Officer 

Naval  Health  Research  Center 

San  Diego,  CA  92152 

Commander,  Naval  Air  Force, 

U.  S.  Pacific  Fleet 
ATTN:  Dr.  James  McGrath 
Naval  Air  Station,  North  Island 
San  Diego,  CA  92135 

Navy  Personnel  Research  and 
Development  Center 
Planning  &  Appraisal  Division 
San  Diego,  CA  92152 


Dr.  Robert  Blanchard 
Navy  Personnel  Research  and 
Development  Center 
Command  and  Support  Systems 
San  Diego,  CA  92152 


Department  of  the  Navy 


Department  of  the  Navy 


CDR  J.  Funaro 

Human  Factors  Engineering  Division 
Naval  Air  Development  Center 
Warminster,  PA  18974 

Hr.  Stephen  Merriman 
Human  Factors  Engineering  Division 
Naval  Air  Development  Center 
Warminster,  PA  18974 

Mr.  Jeffrey  Grossman 
Human  Factors  Branch 
Code  3152 

Naval  Weapons  Center 
China  Lake,  CA  93555 

Human  Factors  Engineering  Branch 
Code  1226 

Pacific  Missile  Test  Center 
Point  Mugu,  CA  93042 

Dean  of  the  Academic  Departments 
U.  S.  Naval  Academy 
Annapolis,  MD  21402 

Dr.  S.  Schiflett 
Human  Factors  Section 
Systems  Engineering  Test 
Directorate 

U.  S.  Naval  Air  Test  Center 
Patuxent  River,  MD  02670 

Human  Factor  Engineering  Branch 
Naval  Ship  Research  and  Development 
Center,  Anapolis  Division 
Annapolis,  MD  21402 

Mr.  Harry  Crisp 
Code  N  51 

Combat  Systems  Department 
Naval  Surface  Weapons  Center 
Dahlgren,  VA  22448 

Mr.  John  Quirk 

Naval  Coastal  Systems  Laboratory 
Code  712 

Panama  City,  FL  32401 


CDR  C.  Hutchins 
Code  55 

Naval  Postgraduate  School 
Monterey,  CA  93940 

Office  of  the  Chief  of  Naval 
Operations  (OP -115) 

Washington,  D.  C.  20350 

Department  of  the  Army 

Mr.  J.  Barber 

HQS,  Department  of  the  Army 
DAPE-MBR 

Washington,  D.  C.  20310 

Dr.  Edgar  M.  Johnson 
Technical  Director 
U.  S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Director,  Organizations  and 
Systems  Research  Laboratory 
U.  S.  Army  Research  Institute 
5001 .  Eisenhower  Avenue 
Alexandria,  VA  22333 

Technical  Director 

U.  S.  Army  Human  Engineering  Labs 

Aberdeen  Porving  Ground,  MD  21005 

Department  of  the  Air  Force 

U.  S.  Air  Force  Office  of  Scientific 
Research 

Life  Sciences  Directorate,  NL 
Bolling  Air  Force  Base 
Washington,  D.  C.  20332 

AFHRL/LRS  TDC 
Attn :  Susan  Ewing 
Wrlght-Patterson  AFB,  OH  45433 

Chief,  Systems  Engineering  Branch 
Human  Engineering  Division 
USAF  AMRL/HES 

Wright-Patterson  AFB,  OH  45433 


34 


Department  of  the  Air  Force 

Dr.  Earl  Alluisi 
Chief  Scientist 
AFHRL/CCN 

Brooks  Air  Force  Base,  TX  78235 

Foreign  Addresses 

Dr.  Daniel  Kahneman 
University  of  British  Columbia 
Department  of  Psychology 
Vancouver,  BC  V6T  1W5 
CANADA 

Dr.  Kenneth  Gardner 
Applied  Psychology  Unit 
Admiralty  Marine  Technology 
Establishment 

Teddlngton,  Middlesex  TW11  OLN 
ENGLAND 

Director,  Human  Factors  Wing 
Defense  &  Civil  Institute  of 
Environmental  Medicine 
Post  Office  Box  2000 
Downsview,  Ontario  M3M  3B9 
CANADA 

Dr.  A.  D ,  Baddeley 

Director,  Applied  Psychology  Unit 

Medical  Research  Council 

15  Chaucer  Road 

Cambridge,  CB2  2EF 

ENGLAND 

Other  Government  Agencies 

Defense  Technical  Information  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  22314  (12  copies) 

Dr.  Craig  Fields 

Director,  System  Sciences  Office 
Defense  Advanced  Research  Projects 
Agency 

1400  Wilson  Blvd. 

Arlington,  VA  22209 

Dr.  M.  Montemerlo 
Human  Factors  &  Simulation 
Technology,  RTE-6 
NASA  HQS 

Washington,  D.  C.  20546 


Other  Government  Agenci.es 
Dr.  J.  Miller 

Florida  Institute  of  Oceanography 
University  of  South  Florida 
St.  Petersburg,  FL  33701 

Other  Organizations 

Dr.  Robert  R.  Mackie 

Human  Factors  Research  Division 

Canyon  Research  Group 

5775  Dawson  Avenue 

Go 1 eta,  CA  93017 

Dr.  Amos  Tversky 
Department  of  Psychology 
Stanford  University 
Stanford,  CA  94305 

Dr.  H.  Mcl .  Parsons 
Human  Resources  Research  Office 
300  N.  Washington  Street 
Alexandria,  VA  22314 

Dr.  Jesse  Orlansky 
Institute  for  Defense  Analyses 
1801  N.  Beauregard  Street 
Alexandria,  VA  22311 

Professor  Howard  Raiffa 
Graduate  School  of  Business 
Administration 
Harvard  University 
Boston,  MA  02163 

Dr.  T.  B.  Sheridan 

Department  of  Mechanical  Engineering 
Massachusetts  Institute  of  Technology 
Cambridge,  MA  02139 

Dr.  Arthur  I.  Siegel 
Applied  Psychological  Services,  Inc. 
404  East  Lancaster  Street 
Wayne,  PA  19087 

Dr.  Paul  Slovic 
Decision  Research 
1201  Oak  Street 
Eugene,  OR  97401 

Dr.  Harry  Snyder 

Department  of  Industrial  Engineering 
Virginia  Polytechnic  Institute  and 
State  University 
Blacksburg,  VA  24061 


35 


Other  Organizations 

Or.  Ralph  Dusek 
Administrative  Officer 
Scientific  Affairs  Office 
American  Psychological  Association 
1200  17th  Street,  N.  W. 

Washington,  D.  C.  20036 

Dr.  Robert  T.  Hennessy 
NAS  -  National  Research  Council  (COHF) 
2101  Constitution  Avenue,  N.  W. 
Washington,  D.  C.  20418 

Dr.  Amos  Freedy 
Perceptronics,  Inc. 

6271  Variel  Avenue 
Woodland  Hills,  CA  91364 

Dr.  Robert  C.  Williges 
Department  of  Industrial  Engineering 
and  OR 

Virginia  Polytechnic  Institute  and 
State  University 
130  Whittemore  Hall 
Blacksburg,  VA  24061 

Dr,  Meredith  P.  Crawford 
American  Psychological  Association 
Office  of  Educational  Affairs 
1200  17th  Street,  N.  W. 

Washington,  D.  C.  20036 

Dr.  Deborah  Boehm-Davis 
General  Electric  Company 
Information  Systems  Programs 
1755  Jefferson  Davis  Highway 
Arlington,  VA  22202 

Dr.  Ward  Edwards 

Director,  Social  Science  Research 
Institute 

University  of  Southern  California 
Los  Angeles,  CA  90007 

Dr.  Robert  Fox 
Department  of  Psychology 
Vanderbilt  University 
Nashville,  TN  37240 

Dr.  Charles  Gettys 
Department  of  Psychology 
Uhiverslty  of  Oklahoma 
455  West  Lindsey 
Norman,  OK  73069 


Other  Organizations 

Dr.  Kenneth  Hammond 
Institute  of  Behavioral  Science 
University  of  Colorado 
Boulder,  CO  80309 

Dr.  James  H.  Howard,  Jr. 

Department  of  Psychology 
Catholic  University 
Washington,  D.  C.  20064 

Dr.  William  Howell 
Department  of  Psychology 
Rice  University 
Houston,  TX  77001 

Dr.  Christopher  Wickens 
Department  of  Psychology 
University  of  Illinois 
Urbana,  IL  61801 

Mr.  Edward  M.  Connelly 
Performance  Measurement 
Associates,  Inc. 

410  Pine  Street,  S.  E. 

Suite  300 
Vienna,  VA  22180 

Professor  Michael  Athans 
Room  35-406 

Massachusetts  Institute  of 
Technology 
Cambridge,  MA  02139 

Dr.  Edward  R.  Jones 
Chief,  Human  Factors  Engineering 
McDonnell-Douglas  Astronautics  Co. 
St.  Louis  Division 
Box  516 

St.  Louis,  MO  63166 
Dr.  Babur  M.  Pulat 

Department  of  Industrial  Engineering 
North  Carolina  A&T  State  Uhiverslty 
Greensboro,  N.  C.  27411 

Dr.  A.  K.  Bejczy 
Jet  Propulsion  Laboratory 
California  Institute  of  Technology 
Pasadena,  CA  91125 


36 


Dr.  Stanley  N.  Roscoe 
New  Mexico  State  University 
Box  5095 

Las  Cruces,  NM  88003 


Mr.  Joseph  G.  Wohl 
Alphatech,  Inc. 

3  New  England  Executive  Park 
Burlington,  MA  01803 


Dr.  Marvin  Cohen 
Decision  Science  Consortium 
Suite  721 

7700  Leesburg  Pike 
Falls  Church,  VA  22043 


Dr.  David  J.  Getty 
Bolt  Beranek  &  Newman,  Inc. 
50  Moulton  Street 
Cambridge,  MA  02238 


Dr.  John  Payne 
Graduate  School  of  Business 
Administration 
Duke  University 
Durham,  NC  27706 


Dr.  Baruch  Fischhoff 
Decision  Research 
1201  Oak  Street 
Eugene,  OR  97401 


Dr.  Wayne  Zachary 
Analytics,  Inc. 

2500  Maryland  Road 
Willow  Grove,  PA  19090 

Dr.  William  R.  Uttal 
Institute  for  Social  Research 
University  of  Michigan 
Ann  Arbor,  MI  48109 

Dr.  William  B.  Rouse 
School  of  Industrial  and  Systems 
Engineering 

Georgia  Institute  of  Technology 
Atlanta,  GA  30332 

Dr.  Richard  Pew 

Bolt  Beranek  &  Newman,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02238 

Dr.  Hillel  Einhorn 
Graduate  School  of  Business 
University  of  Chicago 
1101  E.  58th  Street 
Chicago,  IL  60637 

Dr.  Douglas  Towne 

University  of  Southern  California 

Behavioral  Technology  Laboratory 

3716  S.  Hope  Street 

Los  Angeles,  CA  90007 


Dr.  Andrew  P.  Sage 
School  of  Engineering  and 
Applied  Science 
University  of  Virginia 
Charlottesville,  VA  22901 

Denise  Benel 
Essex  Corporation 
333  N.  Fairfax  Street 
Alexandria,  VA  22314 

Psychological  Documents  (3  copies) 
ATTN:  Dr.  J.  G.  Darley 
N  565  Elliott  Hall 
University  of  Minnesota 
Minneapolis,  MN  55455 


